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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)13 Responsive to communication(s) filed on 15 December 2003 . 
2a)D This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) I3 Claim(s) 1-27 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) |3 Claim(s) lr27 is/are rejected. 

7) 13 Claim(s) 17 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

11) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 1 1 9 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2.D Certified copies of the priority documents have been received in Application No. . 



3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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1 ) S Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Pa P er No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5 ) d Notice of informal Patent Application (PTO-1 52) 

Paper No(s)/Mail Date . 6) □ Other: . 
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DETAILED ACTION 
Response to Amendment 

1. The amendment received on 12/15/03 has been entered. Claims 1-27 remain 
pending. 



Claim Objections 

2. Claim 17 is objected to because of the following informalities: 

Claim 17 improperly depends on claim 1. Claim 17 refers to the apparatus of 
claim 1 , not the method that is previously sated in claim 1 . 
Appropriate correction is required. 

Claim Rejections - 35 USC §112 

3. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

4. Claims 20 and 23 are rejected under 35 U.S.C. 1 12, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter 
which applicant regards as the invention. 

Claims 20 and 23 recite the limitation "the wavelet jets" in line 2. There is 
insufficient antecedent basis for this limitation in these claims. 



Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
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A person shall be entitled to a patent unless - 



(a) the invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. 



6. Claims 1-3, 6, 13, 14, 16, and 18-27 are rejected under 35 U.S.C. 102(a) as being 
anticipated by Wiskott et al. ("Face Recognition by Elastic Bunch Graph Matching"). 

Regarding claims 1, 13, 18, and 21, Wiskott et al. ("Wiskott") discloses 
automatically defining a region of interest in the image indicative of a predetermined 
feature of the person using an early vision cue (Abstract; Sect. 2.2-2.3) and automatically 
finding the location of the predetermined feature in the defined region of interest using 
elastic bunch graph matching (Sect. 2.2-2.3). 

Regarding claim 2, Wiskott discloses the step of defining the region of interest 
includes roughly locating the region of interest using the early vision cue and the step of 
finding the location of the predetermined feature commences at a rough location provided 
by the step of defining the region of interest (Sect. 2.3). 

Regarding claims 3 and 14, Wiskott discloses the early vision cues includes 
structure (Abstract) . 

Regarding claims 6 and 16, Wiskott discloses the predetermined feature is the 
person's face arid the state of the person is described by node positions of facial elements 
(Abstract; Sect. 1; Figure 2). 

Regarding claims 19 and 22, Wiskott discloses the elastic graph matching uses a 
model graph having nodes associated with wavelet jets (Sect. 1-2; Figure 3). 

Regarding claims 20 and 23, Wiskott discloses the wavelet jets are based on 
Gabor wavelets (Sect. 2.1). 
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Art Unit: 2623 

Regarding claims 24-27, the arguments analogous to those presented above for 
claims 1,19, and 20 are applicable to claims 24-27. 



7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

8. Claims 4 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Wiskott et al. ("Face Recognition by Elastic Bunch Graph Matching") as applied to 
claims 3 and 14 above, and further in view of Maki et al. ("A Computational Model of 
Depth-Based Attention"). 

Regarding claims 4 and 15, Wiskott does not disclose using stereovision to 
produce histograms and silhouette images. However, Maki et al. ("Maki") discloses 
using stereovision to produce disparity histograms and silhouette images (Sect. 2-3; page 
738). Wiskott and Maki are combinable because they are from the same field of 
endeavor of computer vision. At the time of the invention, it would have been obvious 
to a person of ordinary skill in the art to have modified the early vision cues disclosed by 
Wiskott to include using stereovision to produce disparity histograms and silhouette 
images. The motivation for doing so would have been because it is a well known 
methodology routinely implemented and provides relative depth information. Therefore, 
it would have been obvious to combine Wiskott with Maki to obtain the invention as 
specified in claims 4 and 15. 



Claim Rejections - 35 USC § 103 
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Art Unit: 2623 

9. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Wiskott et 



and further in view of Wurtz ("Object Recognition Robust Under Translations, 
Deformations, and Changes in Background"). 

Regarding claim 5, Wiskott does not expressly disclose defining the region of 
interest including background suppression. However, Wurtz discloses including 
background suppression (Sect. 2.4). Wiskott and Wurtz are combinable because they are 
from the same field of endeavor of face recognition. At the time of the invention, it 
would have been obvious to a person of ordinary skill in the art to have modified defining 
the region of interest disclosed by Wiskott to include background suppression. The 
motivation for doing so would have been to increase the accuracy of the system by 
providing background independence. Therefore, it would have been obvious to combine 
Wiskott and Wurtz to obtain the invention as specified in claim 5. 
10. Claims 7-10 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Wiskott et al. ("Face Recognition by Elastic Bunch Graph Matching") as applied to claim 
1 above, and further in view of Aboutalib et al. (5,867,587) 

Regarding claim 7, Wiskott does not disclose a sequence of images. However, 
Aboutalib discloses tracking the location of the predetermined feature in a subsequent 
image of a sequence of images (Figure 2). Wiskott and Aboutalib are combinable 
because they are from the same field of endeavor of computer vision. At the time of the 
invention it would have been obvious to a person of ordinary skill in the art to have 
modified the location of the predetermined feature disclosed by Wiskott to include 



al. ("Face Recognition by Elastic Bunch Graph Matching") as applied to claim 1 above, 
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tracking in a subsequent image. The motivation for doing so would have been because it 
is a well known methodology routinely implemented in the art for a sequence of images. 

Regarding claims 8 and 9, Wiskott does not appear to include correcting 
erroneous locations or reinitializing the tracking based on a predicted location. However, 
Aboutalib discloses correcting an erroneous location of a predetermined feature based on 
a model of typical facial features and reinitializing the tracking of the location of the 
predetermined feature based on a predicted location of the predetermined feature (Figure 
7; Col. 3, lines 27-30; Col. 10, lines 35-60). Wiskott and Aboutalib are combinable 
because the are from the same field of endeavor of computer vision. At the time of the 
invention it would have been obvious to a person of ordinary skill in the art to have 
modified the model disclosed by Wiskott to include correcting an erroneous location and 
reinitializing tracking. The motivation for doing so would have been because it increases 
the accuracy of the tracking system of the predetermined feature. Therefore, it would 
have been obvious to combine Wiskott with Aboutalib to obtain the invention as 
specified in claims 8 and 9. 

Regarding claim 10, Wiskott discloses using bunch graph matching (Sect. 2.3). 
The arguments analogous to those presented above for claim 9 are applicable to claim 10. 
1 1 . Claim 1 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over Wiskott et 
al. ("Face Recognition by Elastic Bunch Graph Matching") and Aboutalib et al. 
(5,867,587) as applied to claim 7 above, and further in view of Tuceryan et al. 
(6,044,168). 

Regarding claim 11, Wiskott and Aboutalib do not appear to disclose animating a 
graphical head model. However, Tuceryan et al. ("Tuceryan") discloses using the 
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location of the predetermined feature for animating a graphical head model (Figures 1 1 
and 14; Col 2, lines 53-58; Col 3, lines 61-67, Col. 4, lines 1-7). Wiskott, Aboutalib and 
Tuceryan are combinable because they are from the same field of endeavor of computer 
vision. At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to have modified the head model disclosed by Wiskott and Aboutalib to 
include animating a graphical head model. The motivation for doing so would have been 
because it greatly reduces the amount of data that needs to be processed making it highly 
desirable for video conferencing (Col. 7, lines 7-12). Therefore, it would have been 
obvious to combine Wiskott and Aboutalib with Tuceryan to obtain the invention as 
specified in claim 11.. 

12. Claims 12 and 17 rejected under 35 U.S.C. 103(a) as being unpatentable over 
Wiskott et al. ("Face Recognition by Elastic Bunch Graph Matching") as applied to claim 
1 above, and further in view of Davis, Jr. et al. (5,839,000). 

Regarding claims 12 and 17, Wiskott does not disclose determining the degree to 
which an eye is closed. However, Davis, Jr. et al. ("Davis") discloses determining the 
degree to which an eye is closed (Col. 3, lines 17-25). Wiskott and Davis are combinable 
because they are from the same field of endeavor of computer vision. At the time of the 
invention, it would have been obvious to a person of ordinary skill in the art to have 
modified the face model disclosed by Wiskott to include determining the degree to which 
an eye is closed. The motivation for doing so would have been because it is well known 
and allows for the detection of a reaction of a user's face. Therefore, it would have been 
obvious to combine Wiskott with Davis to obtain the invention as specified in claims 1 2 
and 17. 
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Response to Arguments 



13. Applicant's arguments, see page 12, filed 12/15/03, with respect to the 
rejection(s)of claim(s) 1-3,6-11, and 13 under Maurer et al. (WO 99/53443) have been 
fully considered and are persuasive. Therefore, the rejection has been withdrawn. 
However, upon further consideration, a new ground of rejection is made in view of 
Wiskott et al 



14. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Manjunath, "Gabor Wavelet Transform and Application to Problems in Early 
Vision," IEEE 1992, pages 796-800. 



15. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Virginia M Kibler whose telephone number is (703) 306- 
4072. The examiner can normally be reached on Mon-Thurs 8:00 - 5:30 and every other 
Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amelia Au can be reached on (703) 308-6604. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 
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